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ABSTRACT 

It  Is  shown  that  each  feasible  point  of  a  positive  semidefinite  linear 
complementarity  problem  which  is  not  a  solution  of  the  problem  provides  simple 
numerical  bounds  for  some  or  all  components  of  all  solution  vectors.  Conse¬ 
quently  each  pair  of  primal -dual  feasible  points  of  a  linear  program  which 
are  not  optimal  provide  simple  numerical  bounds  for  some  or  all  components  of 
all  primal-dual  solution  vectors.  For  example  each  feasible  point,  that  Is 
(2»w)^0,  of  the  linear  complementarity  problem  w»Mz  +  q£0,  z^O,  zTw*0, 
where  M  Is  positive  semidefinite,  provides  the  following  simple  bound  for  any 
solution  z  of  the  linear  complementarity  problem: 

i,  <  zfy*1"  »1ti 

where  I  *  {1 >  0>.  If  w>0  then  this  inequality  provides  a  bound  on  the 
1-norm  ||z H-|  of  any  solution  point.  Similarly  each  feasible  point  (x,y) £0 
of  the  primal  linear  program  min  cTx  subject  to  y  *  Ax  -  b  >_  0,  x  £  0,  and 
each  feasible  point  (u,v)^0  of  the  dual  linear  program  max  bTu  subject  to 
v  •  -A*u  u  >0,  u  £  0,  provide  the  following  simple  bounds  for  any  primal 
optimal  solution  (x,y)  and  any  dual  optimal  solution  (u,v): 

I  <  (cTx- bTu)/min  vi  ,,  l  u,  <  (cTx  -  bTu)/min  y,  , 

1c J  1  lei  1  l€ 

where  J»  {1  |v^  >  0}  and  l*{i|y^>0).  If  v>0  we  have  a  bound  on  ||x||<],  and 
If  y>0  we  have  a  bound  on  ||u || -j .  In  addition  we  show  that  the  existence 
of  such  numerical  bounds  is  not  only  sufficient  but  Is  also  necessary  for  the 
boundedness  of  solution  vector  components  for  both  the  linear  complementarity 
problem  and  the  dual  linear  programs. 

AMS  (MOS)  Subject  Classifications:  90C05,  90C20 

Key  Words:  Linear  programming,  quadratic  programming,  bounds 
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SIGNIFICANCE  AND  EXPLANATION 


X 

Surprisingly  simple  bounds  are  given  for  solutions  of  fundamental 
constrained  optimization  problems  such  as  linear  and  convex  quadratic 
programs.  It  Is  shown  that  every  nonoptlmal  primal-dual  feasible  point 
carries  within  It  simple  numerical  Information  which  bounds  some  or 
all  components  of  all  solution  vectors.  The  results  given  permit  one 
to  compute  bounds  without  even  solving  the  optimization  problems. 
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SIMPLE  COMPUTABLE  BOUNDS  FOR  SOLUTIONS 
OF  LINEAR  COMPLEMENTARITY  PROBLEMS 
AND  LINEAR  PROGRAMS 

0.  L.  Mangasarlart 

1 .  Introduction 

The  linear  complementarity  problem  of  finding  a  (z,w)  in  the 

2k 

2k>d1mens1ona1  real  Euclidean  space  R  such  that 

(1.1)  w  *  Mz  +  q  £  0,  z  £  0,  zTw  *  0 

where  M  Is  a  given  k  *  k  real  matrix,  q  is  a  given  k*l  real  vector 
T  k 

and  z  w  denotes  the  scalar  product  7  z4w4  ,  Is  a  fundamental  problem 

1*1  1  1 

of  mathematical  programming  which  Includes  linear  and  quadratic  programming 
problems,  bimatrix  games  [1]  and  free  boundary  problems  [2].  An  Important 
question  of  both  theoretical  and  practical  Interest  Is  the  boundedness  of 
the  solution  set  of  (1.1)  which  already  has  received  attention  In  [8,3,6] 

In  the  form  of  necessary  and/or  sufficient  conditions  for  this  boundedness. 
In  this  work  we  provide  simple  numerical  bounds  for  some  or  all  components 
of  any  solution  vector  when  M  Is  positive  semldeflnlte.  In  particular  we 
show  that  each  feasible  point  (2,w),  that  Is  (z,w)  >  0,  which  Is  not 
a  solution  of  (1.1),  contains  information  on  the  magnitude  of  some  or  all 
components  of  all  solution  points.  For  example  Theorem  2.2  provides  the 
following  simple  bounds  for  any  solution  (z,w)  of  (1.1)  in  terms  of  any 
feasible  point  (z,w)  when  M  is  positive  semideflnlte 

Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29-80-C-0041 . 
This  material  is  based  on  work  sponsored  by  National  Science  Foundation 
Grant  MCS-8200632. 
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'  min 

A 

Wl£l 

(1.2) 

<  H-jll,  <  2TS/ 

min 

A 

Z1fiJ 

wj!l-|  -  gTw/  min  fwi€i»*j€j} 

where  I  *  {i|w^>0},  J  =  {1|z.  >0},  z j :=  z.eJ  and  denotes  the 

1-norm.  Note  that  if  either  I  or  J  Is  empty  then  (z,w)  is  a  solution 
of  the  linear  complementarity  problem  (1.1).  On  the  other  hand  if  w  >  0, 
then  Zj  ■  z  and  (1.2)  provides  a  bound  on  the  1-norm  ||z||^  of  any  solu¬ 
tion  (z,w)  of  (1.1).  Similarly  if  z  >  0.  then  Jij  *  w  and  (1.2) 
provides  a  bound  on  || w || -j .  Theorem  2.2  also  provides  a  necessary  and 
sufficient  characterization  for  the  boundedness  of  Zj,  Wj  and  (Zj.Wj) 
for  I,  J  c  {l,...,k}  where  (z,w)  is  any  solution  of  (1.1)  and  M  is 
positive  semidefinlte.  In  particular  It  shows  that  Zj  is  bounded  if  and 
only  if  there  exists  a  feasible  point  (z,w)  >,  0  such  that  Wj  >  0;  Wj  Is 
bounded  If  and  only  if  there  exists  a  feasible  point  (z,w)  ,>  0  such  that 
2j  >  0;  and  (ij.Wj)  Is  bounded  if  and  only  if  there  exists  a  feasible 
point  (z,w)  >,  0  such  that  (Zj.Wj)  >  0.  Theorem  2.2  can  be  used,  as  in 
Algorithm  2.6,  to  determine  which  components  if  any  of  the  solution  set  are 
bounded,  without  solving  the  linear  complementarity  problem  (1.1).  Theorem 
2.2  also  provides  necessary  conditions  for  the  boundedness  of  solution  com¬ 
ponents  of  (1.1)  when  M  is  copositive  plus,  that  is  M  satisfying  (1.5)- 
(1.6)  below.  In  Theorem  2.8  we  give  bounds  for  the  unique  solution  of  the 
positive  definite  linear  complementarity  problem. 
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Because  a  linear  programming  problem  Is  a  special  case  of  the  linear 
complementarity  problem  [1],  the  bounds  of  Section  2  can  be  used  to  obtain 
bounds  for  solutions  of  the  dual  linear  programs 

(1.3a)  min  cTx  s.t.  y-Ax-b>0,  x^O 

(1.3b)  max  bTu  s.t.  v  ■  -ATu  +  c  >  0,  u  >  0 

where  A  Is  an  m*n  real  matrix,  c  and  b  are  nxi  and  m*l  real 
vectors  respectively.  In  [7]  Robinson  and  In  [5]  this  author  both  gave 
bounds  for  solutions  of  linear  programs  which  Involved  a  constant  which 
was  difficult  to  evaluate  In  general.  By  contrast  In  Section  3  we  provide 
bounds  for  solutions  of  (1.3)  which  Involve  no  constants  or  parameters. 

For  example  Theorem  3.1  provides  the  following  simple  bounds  for  any  solu¬ 
tion  (x,y)-  (u,v)  of  the  dual  linear  programs  (1.3)  In  terms  of  any  pair 
(x,y)  -  (u,v)  of  primal-dual  feasible  points: 


where  »  (1  |Vj  >  0},  J2  *  (1  |x^  >  0),  I-j  *  {1 1 >  0}  and  I2  *  (1  |y^  >  0). 
The  bounds  (1.4)  show  that  every  pair  of  primal-dual  feasible  points  which 
are  not  optimal  (that  is  at  least  y  t  0  or  v  f  0)  can  provide  some 
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information  on  the  size  of  the  solution  set  of  the  dual  linear  programs 

(1.3).  Note  that  If  either  I-,  u  J2  or  J1  u  I?  Is  empty  then  (x,y)  -  (u,v) 

Is  optimal.  If  on  the  other  hand  v  >  0,  then  Xj^  *  x  and  (1.4) 

provides  a  bound  on  the  1-norm  || x )| ^  of  any  solution  (x,y)  of  (1.3a). 

Similarly  If  y  >  0,  then  u,  *  u  and  (1.4)  provides  a  bound  on  the 

l2 

1-norm  ||u||^  of  any  solution  (u,v)  of  (1.3b).  In  Theorem  3.4  we  con¬ 
sider  a  nonsymmetrlc  dual  linear  programming  pair  and  provide  numerical 
bounds  for  its  solution  set. 

We  describe  briefly  now  our  notation.  All  vectors  will  be  column 

vectors  unless  transposed  to  a  row  vector  by  a  superscript  T.  For  a  vector 

x  In  the  n-dimensional  Euclidean  space  Rn,  ||x||  will  denote  an  arbitrary 

fl  _ 

but  fixed  norm  and  ||x||  will  denote  the  p-norm  ||x|!  :«  (  l  |x.  |p) 

P  v  i*l 

where  1  <  p  <  «.  and  ||x||_:*  max  |x.  |.  For  an  m*n  real  matrix  A, 

“  1  <1<n  1 

Aj  denotes  the  ith  row  and  A.j  denotes  the  jth  column,  while  ||A||p 

denotes  the  matrix  norm  subordinate  to  the  vector  norm  ||*|lp» 

MAIL  *  max  ||Ax||  .  The  consistency  condition  ||Ax||  <  ||A||  ||x|| 

p  ||  x  ||  _*1  p  P  P  P 

follows  Immediately  from  this  definition  of  a  matrix  norm.  For  a  subset 

J  c  {1 , . . . ,n),  Xj  or  xicjt  will  denote  those  components  xi  of  the  vector 

x  in  Rn  such  that  i  e  J.  Similarly  for  I  =  {l,...,m),  Aj  will  denote 

those  rows  A.  of  A  such  that  lei,  while  A.,  will  denote  those 
i  j 

columns  A.^  of  A  such  that  j  e  J.  A  vector  of  ones  in  any  real  finite 
dimensional  Euclidean  space  will  be  denoted  by  e.  A  kxk  real  (not 
necessarily  symmetric)  matrix  M  is  said  to  be  copositive  [1]  if 


0.5) 


z  >  0  •*  z  Hz  >  0 


M  Is  said  to  be  copositive  plus  [1]  If  It  Is  copositive  and 


(1.6)  z  >  0,  zTMz  -  0  (M  +  MT)z  »  0 

A  k*k  real  (not  necessarily  symmetric)  matrix  M  Is  said  to  be  positive 
semi  definite  (definite)  If 

z^Mz  >  0  (>  0)  for  all  z  f  0 

Note  that  a  positive  definite  matrix  Is  also  positive  semldefnlte,  while 
a  positive  semldefnlte  matrix  Is  also  a  copositive  plus  matrix. 
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■  «*  '>  ■  »  h  y>%ytJrTM 


2 .  Bounds  for  Solutions  of  Positive  Semldeflnlte  Linear  Complementarity 


Problems 


We  begin  by  a  simple  but  useful  Identity. 


2.1  Lemma  Let  M  be  a  kxk  real  matrix  and  let  q  be  a  k*i  real 


vector.  Then  for  any  z  and  z  In  Rk  such  that  zT(Mz  +  q)  »  0  It 


follows  that 


(2.1)  zT(Mz  +  q)  -  zT(Mz  +  q)  +  zT(Mz  +  q)  +  (z-z)TM(z-z) 


Proof  By  direct  algebraic  verification. 


Before  establishing  the  principal  result  of  this  section,  we  need  to 


define  some  sets.  Let  I  and  J  be  subsets  of  {l,2,...,k>.  Define 


S:»  {(z,w)|z>0,  w»Mz  +  q>0} 


§:■  {(z,w)  |  (z,w)  e  S,  zw  ■  0} 


(2.2) 


SjjJ*  {(Z|W)  |  (Z|W)  £  S,  (Zj,Wj)>0) 

Sjji*  ( ( z j ,  Wj )  |  ( z ,w )  e  S} 

Zjt»  {(z,w)|(z,w)  c  S,  z j  >0} 

2j  :*  (Zjj(z,w)  «  S),  Z:=  {z|(z,w)«S} 
Wj :»  {(z,w) | (z,w)  e  S,  Wj  >  0) 

Wj:a  (wj |(z,w)  e  §},  W:»  {w|(z,w)€§} 


With  these  definitions  it  Is  possible  to  characterize  the  boundedness  of 


solutions  of  linear  complementarity  problems  In  terms  of  simple  numerical 


bounds  as  follows. 


•.  .*  v.  •.  -\  *. 

- V  V  V.  •  .’-W.' 
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2.2  Theorem  Let  M  be  a  k*k  copositive  plus  matrix,  let  S  t  $  and 
let  I  and  J  be  subsets  of  {1,2, ...,k>.  Then 


(a)  Wj  *  *■  Zj  bounded 

(b)  Zj  f  t  bounded 

(c)  Sjj  t  t  *■  Sjj  bounded 


If  In  addition  H  Is  positive  semldeflnlte  then 


(a')  (1)  Wj  j*^~(11)  Zj  bounded  ~  (111) 


(b')  (1)  Zj  f  *  ~  (11)  Mj  bounded  ~  (111) 


(C')  (1)  Sjj  t  * 


~  (11)  bounded  ~  (111) 


Wj  f  4  and 

Pill,  £  zTw/m1n  wicI 

VijeZj,  ¥(z,w)  c  Wj 


Zj  f  $  and 

II*!  II]  <  zTw/m1n  zicI 

¥Wj  €  Wj,  ¥(z,w)  €  Zj 


Sjj  t  t  and 


fl  <  2Tw/min{Zi6j,wi6j} 
1 

Y(2 j#Mj)  €  Sjj,  ¥(z,w)  6  Sjj 


Proof  First  by  Lemke's  algorithm  [1],  It  follows  that  S  M  since  S  t  <t>. 


(a)  We  shall  prove  the  contrapositive  Implication. 


N*  V  *-  S 


.**  .N  ■**  ■'*  .*  .*• 


/. 


■V* -v  v-v-v-'.^ 


BBWOTgggKffgffT  A .»  ? MF.JPJ TOWWy  15  'AW W  A ffffgyTTOTO?7 


R* 

IS 


;y 

& 

55 


£ 
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Wj  »  $  *■*  Mz  +  q  0,  z  £  0,  MjZ  +  qj  >  0  has  no  solution 

T  fu  I  ^ 

++  M  u  <  0,  u  >  0,  0  j*  _  >  0  has  solution 

V-q  uy  “ 

(By  Motzkln's  theorem  of  the  alternative  [4]) 
** M^u  £  0,  u  >  0,  q^u  <  0  has  solution,  or 

M^u  £  0,  u  >0,  q^u  =■  0,  0  f*  Uj  ,>  0  has  solution 

<"*m\i  <_  0,  u  £  0,  q^u  ■  0,  0  +  Uj  >,  0  has  solution 

(qTu  <  0  alternative  excluded  by  S  i  4) 
<■*  u^Mu  «  0,  M^u  £  0,  u  >  0,  q^u  a  0,  0  f  Uj  >  0  has  sr  tlon 

(By  coposltlvlt  -'f  M) 

«-*Mu  ■  -M^u  >0,  u  >0,  q^u  *  0,  0  t  Uj  >  0  has  solut  .<• 

(By  copositivity  plus  of  M) 

“*z  +  XueZ  for  any  (z,w)  e  S,  any  X>0  and  u  >  0, 

Mu  ■  -M^u  £  0,  q^u  *  0,  0  f  Uj  >  0 
■*  Zj  unbounded. 

(b)  We  again  prove  the  contrapositive  implication. 

Zj  ■  $  ~  Mz  +  q  >  0,  z  >  0,  Zj  >  0  has  no  solution 

T  f(MTu)j 

u  <  0,  u  >  0,  0  ^  -  1 


y  j  <  0  has  solution 
q  u 

(By  Motzkln's  theorem) 

~  M^u  <  0,  u  >  0,  q^u  s  0,  0  f  (M^u)j  <  0  has  solution 

(Alternative  q^u  <0  Is  excluded  by  S  f  4>) 

~  Mu  ■  -M^u^O,  u^0,  q^u  *  0,  0?*  (Mu ) j  * -(M^u)j^O  has  solution 

(By  copositivity  plus  of  M) 

■*  z  +  Xu  e  1  for  any  (z,w)  e  S,  any  X  >  0  and  u  >  0, 

Mu  *  -MTu  >  0,  qTu  -0,  0  f  (Mu)j  >  0 
Wj  unbounded. 


(c)  SXJ  bounded  implies  Zj  bounded  and  Wj  bounded.  By  (a)  above  it 
follows  that  Wj  t  and  by  (b)  above  it  follows  that  Zj  t  Let 
(z,w)£WI  and  let  (z,w)  e  Zj.  Then 


(a')  The  implication  (1)*“(i1)  follows  from  (a)  above.  The  implication 
(ii)<-(iii)  is  evident.  We  now  establish  the  implication  (l)^(iii) 
by  means  of  Lemma  2.1.  Let  (z,w) e  Wj  and  Zje2j.  Then  by  Lemma  2.1 
and  the  positive  semi  definiteness  of  M  we  have 


zTw  ■  zT(Mz  +  q)  >  zT(Mz  +  q)  +  zT(Mz  +  q)  >  zj(Mz  +  q)j 

>  llzjll,  w.£l 


Hence 


II*! II,  <  zTw/min  ^iel 


(b')  The  Implication  (1)^(ii)  follows  from  (b)  above.  The  implication 
(11)^(111)  is  evident.  We  now  establish  (1)**(iii).  Let  (z,w) e  Zj 
and  let  vijcWj.  By  Lemma  2.1  and  the  positive  semi  definiteness  of 
M  we  have 

zTw  >,  zTw  +  zTw  >_  ZjWj  >  llwjll  min  z^j 

Hence 

II*! II,  <  zTw/min  2iei 


(c ')  Again  the  implication  (i)«*(ii)  follows  from  (c)  above.  The  implica¬ 
tion  (11)^(111)  is  evident.  To  establish  (i)**(iii),  let  (z,w)eS, 
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and  let  (Zj.Wj)eSjj.  Then  by  Lemma  2.1  and  the  positive  semidefi¬ 


niteness  of  M  we  have 


zw>zw+zw£  z^  +  ZjSj  >  II  ^  min  {Zj€j» 

Hence 


Sj  |  -  *Tw/min  ^zieJ*  "iel} 

d 


2.3  Remark  The  sets  1  and  J  of  Theorem  2.2  above  may  be  taken  as  single- 
tons  in  which  case  the  bounds  in  (a1),  (b')  and  (c')  simplify  respectively  to 

Z1  <  Z  w/w.  for  zi  €  Zi ,  (z,j ,  W| )  £  M| 

wi  <  Z  w/r.  for  wi  e  W. ,  (z^ ,  w- )  e  Zi 

Z.  +  Wj  <  zTw/min  {zJt  w^}  for  (z^,  fij)  e  S^,  (z,w)  e  Sj^ 

2.4  Remark  The  positive  semidefiniteness  assumption  plays  an  indispensable 

role  in  obtaining  the  numerical  bounds  of  parts  (a'),  (b ' )  and  (c')  of 
Theorem  2.2.  It  is  unlikely  that  such  numerical  bounds  can  be  obtained  for 
the  copositive  plus  case.  Whether  the  forward  implications  of  parts  (a), 
(b)  and  (c)  of  Theorem  2.2  also  hold  under  a  copositive  plus  assumption  is 
an  open  question.  However  when  I  *  {l,2,...,k>,  the  forward  assumption 
of  (a)  does  hold  for  a  copositive  plus  M.  See  Theorem  2,  (il)^(ix)  [6]. 

The  following  corollary  which  is  a  direct  consequence  of  part  (a')  of 
Theorem  2.2  provides  a  practical  method  for  determining  which  components  of 
the  solution  set  are  bounded  and  which  are  not  without  solving  the  linear 
complementarity  problem  (1.1). 

2.5  Corollary  Let  M  be  a  k*k  positive  semidefinite  matrix  and  let 
S  f  <fi.  There  exists  a  partition  IuL  of  {l,2,...,k>  such  that 


•-  .*•  *.  *.  %  *.  '  ■  %  •.  ■.  ♦.  - 


(2.3) 


Zj  Is  bounded,  Is  unbounded 


or  equivalently  such  that 


(2.4)  Wj  f  *,  WL  -  * 

One  way  to  determine  the  partition  IuL  of  the  above  corollary  for 
a  given  linear  complementarity  problem  Is  to  solve  at  most  N(I)  linear 
programs,  where  N(I)  Is  the  number  of  elements  In  I,  as  In  the  follow¬ 
ing  Algorithm  2.6.  This  algorithm  determines  the  partition  IuL  of 
{1,2,...,k>  for  a  positive  semldeflnlte  linear  complementarity  problem 
(1.1)  such  that  Zj  Is  bounded  and  Z^  Is  unbounded,  by  determining  Wj 
such  that  Wj  j*  0  and  WL  such  that  •  0.  The  algorithm  which  does 
not  solve  the  linear  complementarity  problem,  solves  at  most  N(I)  (but 
potentially  considerably  fewer)  linear  programs. 


2.6  Algorithm  (Determination  of  IuL  »  {l,2,...,k>  such  that  Zj  Is 
bounded,  ZL  Is  unbounded,  for  a  positive  semldeflnlte  N) 


Step  0: 
Step  1 : 


Set  j  »  0,  I0  ■  *,  Lq  ■  {1 ,2 . k) 

Solve  the  LP:  max  l  (Mz  +  q).  s.t.  Mz  +  q  £  0,  z  £  0 
jcLj  J 


If  LP  Is  Infeasible,  LCP  (1.1)  Is  Infeasible.  Stop. 

If  LP  max  -  0,  set  I  ■  Ij,  L  ■  {1 ,2,... ,k}\lj.  Stop. 

If  0  <  LP  max  <  «,  set  z(A)  *  z  where  z  Is  an  LP  solution. 
If  LP  max  -*•  »,  set  z (X)  *  z  +  Ad  where  z  +  Ad  Is  feasible 


for 


all  A  >  0  and  F  M.d  >  0 
UL  3 


i 


Set  IJ+1  »  IJu{l|H1z(A)+q1  >0,  X  +  »> 

Lj+^  ■  (1  »2,...,k}\lj+.| 


yl> 


Step  2:  j  +  1  -*•  j 
Step  3:  Go  to  Step  1. 

2.7  Remark  The  LP  solutions  of  Algorithm  2.6  can  be  used  In  conjunction 
with  Theorem  2.2  (a'iil)  to  give  numerical  bounds  for  i| Zj || ^ •  ZjeZj. 

When  M  Is  positive  definite,  additional  simple  bounds  can  be 
obtained  as  follows. 

2.8  Theorem  Let  M  be  a  k*k  positive  definite  matrix  with  a  >  0  being 

the  smallest  eigenvalue  of  and  8  >  0  the  smallest  eigenvalue  of 

M  1  ■)-  .  Then  the  unique  solution  (z,w)  of  the  linear  complementarity 

(1.1)  Is  bounded  by 

(2.5a)  max  {0,  ||z||2  -  (z^/a)1*}  <  ||z||2  <  l|z H2  +  (z^/a)*5 

(2.5b)  max  {0,  ||w||2  -  (w^/fi)15)  <  ||w|l2  <  ||w||2  +  (w Tz/&)i* 

for  any  feasible  z  >  0,  5  ■  Hi  +  q  >  0. 


Proof  By  Lemma  2.1  we  have  that 


zTw  >  (z  -  z)TM(z  -  z)  >  a||z  -  z||* 


Hence 


Pll,  <11*11,  ♦  II* -ill,  <  11*11,  ♦  uW 


which  gives  the  second  Inequality  of  (2.5a).  The  first  Inequality  of  (2.5a) 


follows  from 


iT~  /  \h 


11*11,  <  11*11,*  ll*-*ll,<  ||i||  ,♦  (*V«) 


.  .  .  - 

•  •>  *  .  .  •  >Vi  '  .  • .  • 
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To  obtain  (2.5b)  note  first  that  M  Is  nonsingular,  for  If  it  were 
singular  then  Mz  *  0  for  some  z  j*  0  and  consequently  zTMz  «  0  which 

b 

contradicts  the  positive  definiteness  of  M.  Furthermore  for  0  i*  y  tR  , 
we  have  z  ■  M*^y  f  0  and 

yV'y  •  zVh-’hz  -  zVz  -  zMz  >  0 

Hence  Is  positive  definite.  For  a  nonsingular  M  the  linear  comple 

mentarlty  problem  (1.1)  Is  equivalent  to 

(2.6)  z  -  M-1w  -  M_1q,  w  >  0.  wTz  •  0 

Hence  (2.5a)  of  this  theorem  applied  to  (2.6)  yields  (2.5b).  □ 


3.  Bounds  for  Solutions  of  Linear  Programs 

We  begin  this  section  with  some  results  which  are  direct  consequences 
of  Section  2.  These  results  follow  by  considering  the  pair  of  dual  linear 
programs  (1.3)  as  a  linear  complementarity  problem  with  a  skew-symmetric, 
and  hence,  positive  semldeflnlte  matrix.  Later  on  In  this  section  we  shall 
obtain  bounds  for  solutions  of  linear  programs  with  explicit  equality 
constraints. 

By  considering  the  dual  linear  programs  (1.3)  as  a  linear  complemen¬ 
tarity  problem  [1]  defined  by  (1.1)  and 


(3.1) 


H:'C  z:*  Q'  w:'Q 


the  following  theorem  Is  a  direct  consequence  of  Theorem  2.2. 


3.1  Theorem  Assume  that  the  dual  linear  programs  (1.3)  are  both  feasible 
and  hence  both  solvable.  Let  caret  variables  (x,y),  (u,0)  denote  primal 
and  dual  feasible  vectors  respectively,  that  Is 

(3.2)  y  ■  Ax  -  b  >  0,  x  >  0,  v  -  -ATu  +  C  >  0,  u  >  0 


and  let  bar  variables  (x,y),  (u,v)  denote  primal  and  dual  optimal  vectors 
respectively,  that  Is 

(3.3)  y  -  Ax  -  b  >  0,  x  >  0,  v  ■  - ATu  +  c  >  0,  u  >  0,  cTx  -  bTG  -  0 
Let  J  c  {1,2 . n)  and  let  I  c  (1 ,2 . m}.  Then  the  following 


equivalences  hold: 
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i: 


(al )  3vj>0^**VXj  bounc'ad  *■*  /3$j  >  0;  V(x,$),  VO  s.t.  $j>0: 

\  Pjll,  <  (cTx-bTu)/m1n  vjeJ 

(a2)  3Pj  >  0  **  VUj  bounded**  /9Pj  >  0;  ¥(u,u),  Vx  s.t.  yj  >  0: 


llGlll1  i  (cT^  -  bTu)/min  yul 


(bl )  3xj>0^VVj  bounded**  ^/3Xj>0;  Y(v,u),  Vx  s.t.  Xj>0: 

^J^l  — (cTx-  bTu)/m1n  XjeJ 


(b2)  3uj>0**VyI  bounded  **/30j  >  0;  V(y,x),  Vu  s.t.  Uj>0: 


11^1  II,  <cT*  -  bTu)/m1n  ul£l 


(cl)  3vj>0,Uj  >  0^V(xj,y,)  bounded**  ^/3vj>0,  U|>0;  V(x,x)»  Vu  s.t.  Vj>0,  Gj>0: 

<  (cTx  -  bTu)/m1n  (VjeJ,  Q^j) 


(c2)  3pj  >0,  2j>  O^V(uj,Vj)  bounded-**  /3yj>0,  Xj>0;  V(u,u),  lx  s.t.  pjX),  Xj>0: 


<  (cTx- bTu)/m1n  (yi€i»Xj€j> 


3.2  Corollary  The  quantity  cTx  In  parts  (al),  (b2)  and  (cl)  of  Theorem  3.1 
can  be  replaced  by  any  upper  bound  a  to  min  cTx  s.t.  Ax  >_  b,  x  >  0,  while 
the  quantity  b^u  In  parts  (a2),  (bl)  and  (c2)  of  Theorem  3.1  can  be  replaced 
by  any  lower  bound  6  to  max  b^u  s.t.  A^u  <  c,  u  £  0. 


Proof  To  prove  the  first  part,  set  x  In  (al),  (b2)  and  (cl)  equal  to  a 


solution  x  of  (1.3a)  and  note  that  cTx  «  cTx  <_  a.  To  prove  the  second  part. 


set  u  In  (a2),  (bl)  and  (c2)  equal  to  a  solution  u  of  (1.3b)  and  note  that 

□ 


-bTu  ■  -bTu  <  -0. 


.•  '--.v.v. \  , 

•  *.**  •*  •  .*  A 

vVlvV.-. v\v 

.  ,  _J  /iVl  P  _  f  jbVjiVj*  *-J*  Ca  -*  ■*-  Jl2 
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3.3  Remark  When  the  Index  sets  I,  J  are  taken  as  singletons,  the  first 
equivalence  In  each  of  the  statements  (al )  to  (c2)  of  Theorem  3.1  reduce  to 
Theorem  3b  of  Williams  [11].  In  [10]  Williams  characterizes  boundedness  of 
components  of  feasible,  but  not  optimal,  points  of  linear  constraint  sets. 
In  [9]  Williams  characterizes  the  boundedness  of  the  totality  of  all  the 
components  (In  contrast  with  Individual  components)  of  optimal  points  of 
linear  programs.  None  of  Williams'  characterizations  contain  quantitative 
bounds  like  ours. 

We  turn  our  attention  now  to  the  nonsymmetrlc  pair  of  dual  linear 


programs 

(3.4a) 

min  cTx  s.t.  Ax  »  b,  x  >  0 

(3.4b) 

max  bTu  s.t.  v  ■  -ATu  +  c  >_  0 

and  establish  the  following  bounds  for  their  solutions. 

3.4  Theorem  Assume  that  the  dual  linear  programs  (3.4)  are  both  feasible 
and  hence  both  solvable.  Let  caret  variables  denote  primal  and  dual 
feasible  vectors,  that  Is 

(3.5)  Ax  ■  b,  x  >,  0,  v  ■  -ATu  +  c  >  0 

and  let  bar  variables  denote  primal  and  dual  optimal  vectors,  that  Is 

(3.6)  Ax  ■  b,  x  >_  0,  v  ■  -ATu  +  c  >_  0,  cTx  -  bTu  ■  0 

Let  J c {1 ,2,...,n}  and  I c {1 ,2,...,m}.  Then  the  following  equivalences 


hold: 


(al )  (1)  3vj>0~(11)  VXj  bounded •*(  1 1 1 )  /3vj>0;  V(x,X),  Vu  s.t.  Vj>0: 

\  Pjl^  <  (cTx-bTu)/i»1n  $jcJ 

(a2)  (1)  3x>0  and  rows  of  A  lln.  1ndep.~(11)  fu  bounded 

♦•(111)  /3x>0  and  rows  of  A  1  In.  Indep;  V(u,u),  Vx>0: 

\  II = II !  <  II (AAT )-’ A II  ( lie II  +(cTx -  bTa )/*1  n  *  ) 
N  11  1<1<n  1 

(bl)  (1)  3xj>0«-*{11)  VVj  bounded  •■•(1 11 )  /3xj>0;  V(v,u),  Vx  s.t.  Xj>0: 

\  l|vjll1<(cTx-bTu)/ratn  xj£j 


Proof,  (al):  (11)  ^  (111):  Evident. 


(1)*"(11):  We  establish  the  contra  positive  Implication. 

^Vj  >0^-ATu +  CC  >0,  (-ATu  ♦cc)j  >  0,  C>0  has  no  solution 

♦■•-Ax  -  A.^Zj  *  0,  cTx  ♦  c  jZj  +  n  ■  0,  x>0,  0A  (tj.n)  >0,  has  solution 

(By  Motzkln's  theorem) 

T 

♦•-Ax  >  0,  c  x  +  n  ■  0.  x  £  0,  0  A  (Xj,n)  >  0  has  solution 
«•  (n  ■  0)  For  each  solution  x  of  (3.4a),  x  +  Xx  Is  also  a  solu¬ 
tion  for  any  X>0,  where  Ax»0,  cTx  ■  0,  x>0,  OAXj^O 
(n>0  excluded,  because  It  Implies  (3.4a)  1$  unbounded  below, 
which  Is  ruled  out  by  primal-dual  feasibility  assumption) 
•  3  unbounded  Xj 

(1 ) •(111 ):  cTx  >  cTx  -  bTu  ■  bTu  +  xTv>bTu  +xTv>bTu  +  xjvj 

>  bTu  +  ISjH,  min  vj£j 

Hence 

ilxjll1  <  (cTx-bTu)/m1n  vj£j 


(a 2 ) :  (11)  •(111):  Evident. 


We  shall  prove  the  contrapositive  implication. 


Rows  of  A  1  In .  dep.  or  Jx  >  0  such  that  Ax  *  b 


Rows  of  A  1  In .  dep.  or  0  M  t  J  >  0  has  solution 

V  b  uj  " 


(By  Motzkln's  theorem) 


♦■♦Rows  of  A  lln.  dep.  or  0  i>  -A^u  >  0,  b^u  «  0  has  solution 


(Case  of  -A^u  >  0.  b^u  >  0,  ruled  out  because  It  Implies 


(3.4b)  Is  unbounded  above  which  Is  Impossible  by  primal -dual 


feasibility  assumption) 


For  each  solution  u  of  (3.4b),  u  +  Xu  is  also  a  solution 


for  any  X  >  0  where  either  bTu  •  0,  A^u  -  0,  u  f  0  or 


bTu  ■  0,  0  A  -ATu  j>  0. 


■»  j  unbounded  u 


(1)-*(111):  Since  A  S  *  c  -  v  and  rows  of  A  are  linearly  Independent 


It  follows  that  u  ■  (AA1)  A(c-v)  and  hence 


<  II(aat)*,a||1(||c||1  ♦  ||v II ^ ) 


bTu  <  cTx  -  cTx  -  vTx  <  cTx  -  vTx  <  cTx  -  || v ||  i  min 

1 <1<n  1 


Hence 


||v||  <  (cTx- bTu)/min  x, 

1  '!<1<n 


and  consequently 


11=11,  <  l!(AAT)'’A|l  (||c||  +  (cTS  -  bT0)/m1n  8  > 
1  '  1  ' 1 <1<n 
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(a3):  (11)  •(HI):  Evident. 

(1)  •(ll):  We  shall  prove  the  contrapositive  Implication. 


such  that  Xj  >  0,  x  >  0  and  Ax  ■  b 


-ATU 


+  v  ■  0,  b  u  £  0,  v 


“CO 


+  0,  has  solution 


(By  Motzkln's  theorem) 

~ATu  +  v  ■  0,  bTu  *  0,  v  >  0,  Vj  f  0  has  solution 

(Case  of  bTu  >  0,  ATu  +  v  *  0,  v  >  0,  ruled  out  because 
It  Implies  (3.4b)  Is  unbounded  above  which  Is  Impossible 
by  primal -dual  feasibility  assumption) 

•  For  each  solution  <u,v)  of  (3.4b),  (ii  +  Xu,  v  +  Xv)  is 

•  T 

also  a  solution  for  any  X  >  0  where  A  u  +  v  »  0, 
bTu  ■  0,  v  >  0,  Vj  t  0. 

•  i  unbounded  Vj 


(1  )"*(111 ):  bTu  <  cTx  »  cTx  -  vTx  <  cTx  -  vTx  <  cTx  -  VjXj 

<  cTx  -  llvjll,  min  xjeJ 


Hence 

i  <cTx  -  bTu)/m1n  xJeJ  □ 
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1  A  A 

norm  ||z|.  of  any  solution  point.  Similarly  each  feasible  point  (x,y)  >  0 

X  ip 

the  primal  linear  program  min  c  x  subject  to  y=Ax-b>0^x>0,  and 

ch  feasible  point  (u,v)  >0  of  the  dual  3. inear  program  max  b  u  subject  t 
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n  w  T7*  TA  A  P  m  a  *p  /k,  a 

)  x.  <  (c  x  -  b  u)/min  v.^_,  l  u.  <  (c  x  -  b  u)/min  y. 

. 1  =  l£J  . 1  — 

i€J  id 

ere  J  =  {i  Iv^.  >  0}  and  I  =  {i|y^  >  0).  If  v  >  0  we  have  a  bound  on  ||x 

d  if  y  >  0  we  have  a  bound  on  ||u||^.  In  addition  we  show  that  the  existen 
such  numerical  bounds  is  not  only  sufficient  but  is  also  necessary  for  the 
undedness  of  solution  vector  components  for  both  the  linear  complementarity 


